Papers with completion rate
PwnGPT: Automatic Exploit Generation Based on Large Language Models (2025.acl-long)
Copied to clipboard
Wanzong Peng, Lin Ye, Xuetao Du, Hongli Zhang, Dongyang Zhan, Yunting Zhang, Yicheng Guo, Chen Zhang
| Challenge: | Automated exploit generation (AEG) is the automatic discovery and exploitation of vulnerabilities against unknown targets. |
| Approach: | They propose an automatic exploit generation framework that automatically solves pwn challenges by using large language models. |
| Outcome: | The proposed framework improves the completion rate of exploits on the openAI o1-preview model and the GPT-4o model. |
TPS-Bench: Evaluating AI Agents’ Tool Planning & Scheduling Abilities in Compounding Tasks (2026.acl-long)
Copied to clipboard
| Challenge: | Large language model (LLM) agents have demonstrated strong problem-solving competence across domains like research and coding. |
| Approach: | They propose to use a tool repository to analyze the ability of large language model agents to solve complex problems. |
| Outcome: | The proposed model outperforms open-source and closed-source models in task completion rate and efficiency. |